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[57] ABSTRACT 

A macroblock packet format is provided for use in a 
digital HDTV system wherein successive video frames 
are divided into a plurality of macrobiocks. The mac- 
roblocks comprise a plurality of superblocks, each con- 
taining a plurality of luminance and chrominance video 
data blocks. A DLEN field is provided in the macrob- 
lock packet format to identify the length of the macrob- 
lock packet. The packets also include variable length 
encoded portions of video data. The macroblock pack- 
ets are transmitted in a data multiplex that also includes 
a next macroblock position (NMP) word. A receiver 
compares the DLEN information with the NMP word 
to verify synchronization, and reacquires the signal if 
synchronization has been lost. 

31 Claims, 4 Drawing Sheets 
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ratus for Refreshing Motion Compensated Sequential 
DIGITAL HDTV DATA PACKET FORMAT AND Video Images," both incorporated herein by reference. 

RECEIVER THEREFOR In the system disclosed in the '724 patent, video sig- 

nals are processed with motion compensation (DPCM) 
BACKGROUND OF THE INVENTION 5 and without motion compensation (PCM), and a com- 
The present invention relates to the communication parison is made to determine which type. of processing 
of digital high definition television (HDTV) data, and results * the least amount of data for transmission. U.S. 
more particularly to a data packet format for communi- Pat No. 5,091,782 entitled "Apparatus and Method for 
eating HDTV data and a receiver for receiving such Adaptively Compressing Successive Blocks of Digital 
data 10 Video" and incorporated herein by reference, discloses 

Television signals are conventionally transmitted in a system wherein video signals are provided in both a 
analog form according to various standards adopted by frame format and a field format for processing with 
particular countries. For example, the United States has motion compensation. The resultant signals are com- 
adopted the standards of the National Television Sys- pared on a block-by-block basis to determine which 
tem Committee ("NTSC"). Most European countries 15 format yields the fewest errors, 
have adopted either PAL (Phase Alternating Line) or Motion estimation of a video signal is provided by 
SECAM (sequential color and memory) standards. comparing the current luminance block with the lumi- 

Digital transmission of television signals can deliver nance blocks in the previous frame within a specified 
video and audio services of much higher quality than tracking range. The previous frame luminance block 
analog techniques. Digital transmission schemes are 20 with the roinmniTn total absolute change compared to 
particularly advantageous for signals that are broadcast the current block is chosen. The position of the chosen 
by satellite to cable television affiliates and/or directly Hoc* is called the motion vector, which is used to ob- 
to home satellite television receivers. It is expected that ^ tne predicted values of the current block. For addi- 
digital television transmitter and receiver systems will tional coding efficiency, the motion vectors can be 
replace existing analog systems just as digital compact 2 * differentially encoded and processed by a variable 
discs have largely replaced analog phonograph records length encoder for transmission as side information to a 
in the audio industry. decoder. A low pass filter may be provided in the 

A substantial amount of digital data must be transmit- DPCM loop for the purpose of smoothing out the pre- 
ted in any digital television system. This is particularly dictcd values ^ ne cessary. In order to protect the coded 
true where high definition television is provided. In a 30 bitsUeam from var ious kinds of random noise, a for- 
digital television system, a subscriber receives the digi- ward error correction (FEC) scheme can be used, 
tal data stream via a receiver/descrambler that provides Qne category 0 f coding schemes for compressing the 
video, audio, and data to the subscriber. In order to dflt& ^ . removing redundant information is known 
most efficiently use the available radio frequency spec- ^ „ cnt coding." Another category, which relies on 
trum, it is advantageous to compress the digital televi- 35 ^ vaoe ^ tm ) yields results 

sion signals to minimize the amount of data that must be ^ ^ ^ lossy Bus> picture quality ^ ^ de graded 

transmitted. h ^ j atter is used i n implementing such tech- 

The video poruon of a tension "l^ompr^ » ^ either mtraframe or i^rfnune coding can be 
sequence of video frames" that together provide a codin used for the first picture and 

moving picture, b. digital television systems, each line 40 « scene. Interframe 

of a video frames defined by a sequence of digital data ™ « P sequences of pictures containing 

referred to as "pixels. "A large amount of data is re- ~dmg ; « t»ed tor *j p^ expression 

more data to provide each video frame. In order to Doc. No. 525. ^~ X V*|;^*"' 
manage this amount of ^ic^y for HDTV 50 ^^^^^^J^- 
^^£™^" P ££*< efficient Serential pu.se. coded modulo/ (DPCM) with 
tranmiL™ of digital video signals over conventional motion estimation is used. The DPCM is not optative 
cmnmunication channels. Such techniques use compres- for mtraframe coding. For entropy coding, both one- 
Zr g oShms that take advantage of the correlation 55 andtwc-dimensional vana^ble len^c^gs axe used, 
among adjacent pixels in order to derive a more effi- The discrete cosine transform (DCT) desenbed by N. 
cknt g reSStion of the important information in a Ahmed. T. Naterajan and K. K. Rao. "Discrete Cosme 
videolgnal. The most powerful compression systems Transform." IEEE Trans. Computer, \o\ C-23. pp. 
not^yCe advantage "of spatial correlation, but can 90-93, Jan. 1974. is used m the CCITT system to con- 
also utiL similaritiestmong adjacent frames to further 60 vert the mput data, which is divided mto iMcrobfocks 
compact the data. In such systems, differential encoding and sub-blocks, into transform coefficients. The DCT 
(DPCM) is used to transmit only the difference between transform is performed on the difference between 
an actual frame and a prediction of the actual frame. blocks of current frame data and corresponding blocks 
The prediction is based on information derived from a of a predicted frame (which is obtained from the previ- 
nrevious frame of the same video sequence. Examples 65 ous frame information). If a video block contains no 
of such systems can be found in U.S. Pat. Nos. 5.068,724 motion or the predicted value is exact, the mput to the 
entitled "Adaptive Motion Compensation for Digital DCT will be a null matnx. For slowly moving pictures, 
Television" and 5,057,916 entitled "Method and Appa- the input matrix to the DCT will contain many zeros. 
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The output of the DCT is a matrix of coefficients which 
represent energy in the two-dimensional frequency 
domain. In general, most of the energy is concentrated 
at the upper left corner of the matrix, which is the low 
frequency region. If the coefficients are scanned in a 
zigzag manner, the resultant sequence will contain long 
strings of zeros, especially toward the end of the se- 
quence. One of the major objectives of this compression 
algorithm is to create zeros and to bunch them together 
for efficient coding. 

To maintain efficiency, a variable threshold is also 
applied to the coefficient sequence before quantization. 
This is accomplished by increasing the DCT threshold 
when a string of zeros is detected. A DCT coefficient is 
set to zero if it is less than or equal to the threshold. 

A uniform quantizer is used alter the transform. The 
step size of the quantizer can be adjusted by the trans- 
mission rate as indicated by the occupancy of a buffer. 
When the transmission rate reaches its limit, the step 
size will be increased so that less information needs to 20 
be coded. When this occurs, a degraded picture will 
result. On the other hand, picture quality will be im- 
proved by decreasing the step size when the transmis- 
sion rate is below its limit. 

To further increase coding efficiency, a two-dimen- 
sional variable length coding scheme is used for the 
sequences of quantized DCT coefficients. In a given 
sequence, the value of a non-zero coefficient (ampli- 
tude) is defined as one dimension and the number of 



The present invention provides a data packet format 
for use in a digital HDTV system, as well as a receiver 
for such packets, all having the aforementioned advan- 



10 



15 



25 



zeros preceding the non-zero coefficient (runlength) is 30 motion compensation), 



SUMMARY OF THE INVENTION 
In accordance with the present invention, a macrob- 
lock packet format is provided for use in a digital 
HDTV system- In the HDTV system, successive video 
frames are each divided into a plurality of macroblocks 
which, in turn, comprise a plurality of superblocks. The 
superblocks contain a plurality of luminance and chro- 
minance video data blocks. The macroblocks are pro- 
cessed into variable length macroblock packets for 
transmission, using various known compression tech- 
niques such as motion compensation, quantization, and 
variable length encoding. The macroblock packet for- 
mat comprises a DLEN field identifying the length of 
the macroblock packet, and a compressed, variable 
length encoded portion of video data. 

The macroblock packet format can further comprise 
an MPCM field identifying whether the entire macrob- 
lock packet has been encoded in PCM mode (i.e., with- 
out motion compensation). In the event that the entire 
macroblock packet has not been encoded in PCM 
mode, at least one additional -PCM field is provided for 
distinguishing between portions of superblocks that 
comprise PCM encoded data and portions of super- 
blocks that comprise DPCM encoded data (Le. ( with 



defined as another dimension. The combination of am- 
plitude and runlength is defined as an "event." 

A shorter length code is assigned to an event which 
occurs more frequently. Conversely, infrequent events 
receive longer length codes. An EOB (end of block) 35 
marker is provided to indicate that there are no more 
non-zero coefficients in the sequence. 

The coded coefficient values are multiplexed to- 
gether with various side information such as block clas- 



A first additional -PCM field that can be provided in 
the macroblock packet is an SPCM field. This field 
specifies whether all of the blocks of video data in a 
particular superblock comprise PCM encoded data, or 
all of the blocks of video data in the particular super- 
block comprise DPCM encoded data, or one luminance 
block of video data in the particular superblock com- 
prises PCM encoded data and the rest of the blocks 
comprise DPCM encoded data, or PCM and DPCM 



sification, quantization information, and differential 40 encoded blocks of video data occur arbitrarily in the 



motion vectors. Some of the side information may also 
be variable length coded. The resultant bitstream is sent 
to a buffer for transmission. 

At a receiver, a variable length decoder is necessary 
to perform the inverse operation of the encoder and 45 
recover the transform coefficients. In order to increase 
the efficiency of the receiver, it is desirable to transmit 
the variable length coded data in a format that provides 
useful information to the receiver. For example, it 
would be advantageous to provide a data format that SO 
includes various data fields that enable the receiver to 
avoid unnecessary processing. It would also be advanta- 
geous to indicate to the receiver whether a data packet 
currently being received has been encoded as DPCM 
data or PCM data. If the data has been encoded as PCM 55 
data (i.e., without motion compensation), then the re- 
ceiver could be instructed to skip over any processing 
relating to motion compensation. Similarly, where a 
received packet does not contain video data, the re- 
ceiver could be instructed to bypass the decoding rou- 60 
tines that relate to the processing of video data. It 
would be still further advantageous for the transmitted 
data format to provide a field that indicates the length 
of a received data packet. Such information would be 
useful to prevent a loss of synchronization in the event 65 
of a transmission error. Other information useful to the 
receiver can also be advantageously provided in trans- 
mitted data packets. 



particular superblock. In the case where data has been 
encoded using motion compensation, a motion vector 
field is provided that contains motion vector data corre- 
sponding to the DPCM encoded data. 

A second additional -PCM field is an LPCM field 
that is used when one luminance block in a superblock 
is PCM encoded and all other video data blocks in the 
superblock are DPCM encoded. The LPCM field iden- 
tifies the PCM encoded luminance block. 

An alternative additional -PCM field is a DPCM field 
that is used when PCM and DPCM encoded blocks of 
video data occur arbitrarily in a superblock. The 
DPCM field identifies which of the blocks of video data 
in the superblock are PCM encoded and which are 
DPCM encoded. 

The macroblock packet format can further comprise 
a QL field for indicating a global quantization level of 
the superblocks. A DQL field can be provided to indi- 
cate a quantization level of superblocks that do not use 
the global quantization level. A VQL field is provided 
for indicating a correction factor to be applied to the 
global quantization level. 

An FID field is provided for indicating if a macrob- 
lock packet is the first macroblock packet in a new 
video frame. When a receiver detects the occurrence of 
a new video frame from the FID field, it will jump to a 
special subroutine for processing additional fields that 
specifically relate to the occurrence of the new video 
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frame. For example, a FILM field is provided to indi- vided that are responsive to a detected FID field for 
cate, during the first macroblock packet in a new video detecting a DFM field in a received macroblock packet, 
frame, whether data in the new video frame is provided The DFM field indicates, during the first macroblock 
in a video mode or a film mode. A BFM field is pro- packet in a new video frame, a frame number for the 
vided for indicating, during the first macroblock packet 5 new vided frame. 

in a new video frame, a frame number for the new video Memory means can be provided for storing a film/v- 
frame. ideo mode flag derived from the FILM field. Means 

In an illustrated embodiment, successive video frames responsive to an indication by the film/video mode flag 
are divided into a plurality of subframes, each subframe that a video frame in which the macroblock packet 
containing a subset of the plurality of macroblocks. A 10 resides contains data in a video mode, detect an FLD 
CID field is provided in the macroblock packet format field in a received macroblock packet. The FLD field 
to indicate the subframe with which a current macrob- indicates in which of a frame mode and a field mode 
lock packet is associated. each of the superblocks corresponding to the received 

The illustrated embodiment also contemplates the macroblock packet has been processed. Means respon- 
processing of the superblocks in one of a frame mode 15 sive to a detected FID field proceed to receive a next 
and a field mode. An FLD field is provided in the mac- successive macroblock packet after the detection of the 
roblock packet format to indicate in which of the frame film and DFM fields. 

mode and field mode each of the superblocks has been The receiver apparatus can further comprise means 
processed. for detecting a QL field in a received macroblock 

Receiver apparatus in accordance with the present 20 packet that indicates a global quantization level of the 
invention decodes variable length digital HDTV mac- superblocks. Means responsive to a detected QL field 
roblock packets representative of macroblock portions proceed to receive a next successive macroblock packet 
of successive video frames. The macroblock portions when the QL field indicates a global quantization level 
comprise a plurality of superblocks. The superblocks that exceeds a predetermined value. Means are also 
contain a plurality of luminance and chrominance video 25 provided for detecting a DQL field in a received mac- 
data blocks. Means are provided for detecting a DLEN roblock packet. The DQL field indicates a quantization 
field in a received macroblock packet. The DLEN field level of superblocks that do not use the global quantiza- 
identifies the length of the macroblock packet. Means tion level. Means responsive to a detected DQL field 
responsive to a detected DLEN field maintain a plural- detect a VQL field in a received macroblock. The VQL 
ity of received macroblock packets in synchronization 30 field indicates a correction factor to be applied to the 
for the recovery of video data therefrom. global quantization level when the DQL field indicates 

In a preferred embodiment, the receiver apparatus that the quantization level used for one or more super- 
further comprises means for detecting an MPCM field blocks of the current macroblock packet differ from the 
in a received macroblock packet. The MPCM field global quantization level. 

identifies whether the entire macroblock packet has 35 In a preferred embodiment, the successive video 
been encoded in PCM mode. Means responsive to a frames are divided into a plurality of subframes. Each 
detected MPCM field detect at least one additional subframe contains a plurality of macroblock portions. 
-PCM field in the event that the entire macroblock The receiver apparatus comprises means for detecting a 
packet has not been encoded in PCM mode. The at least CID field in a received macroblock packet. The CID 
one additional -PCM field comprises an SPCM field to 40 field indicates the subframe with which the macroblock 
indicate which of PCM encoded data and DPCM en- packet is associated. 

coded data are included in the video data blocks of a As indicated above, the receiver apparatus includes 
superblock. means responsive to a detected DLEN field for main- 

The means for detecting at least one additional -PCM taming a plurality of received macroblock packets in 
field can further detect one of an LPCM and a BPCM 45 synchronization for the recovery of video data there- 
field for each superblock having both PCM and DPCM from. In a preferred embodiment, the macroblock pack- 
data. The LPCM field is present when one luminance ets received by the receiver are contained in video por- 
block in the superblock is PCM encoded and all other tions of successive lines of HDTV data. These lines 
video data blocks in the superblock are DPCM en- contain additional data, that is also received and used by 
coded. The LPCM field identifies the PCM encoded 50 the receiver. At least one such line in each new video 
luminance block. The BPCM field is present when frame includes a next macroblock position (NMP) word 
PCM and DPCM encoded blocks of video data occur that indicates the beginning position of the next macrob- 
arbitrarily in a superblock. The BPCM field identifies lock in the following video data portion of the line, 
which of the blocks of video data in the superblock are Means are provided for recovering the NMP word, and 
PCM encoded and which are DPCM encoded. The 55 comparing it to DLEN data recovered by the receiver 
receiver apparatus further comprises means for detect- to determine if they both point to the same position in 
ing a motion vector field in a received macroblock the received data stream. If they do not point to the 
packet containing motion vector data corresponding to same position, an error has occurred and the signal is 
DPCM encoded blocks of video data. reacquired to provide proper synchronization. 

The receiver apparatus can further comprise means 60 DESCRIPTION OF THE DRAWINGS 

for detecting an FID field in a received macroblock 

packet for indicating if the macroblock packet is the FIG. 1 is a diagrammatic illustration showing how a 
first macroblock packet in a new video frame. Means video frame is subdivided into subframes, macroblocks, 
responsive to a detected FID field detect a FILM field superblocks, and blocks containing eight bit bytes of 
in a received macroblock packet. The FILM field indi- 65 pixel data; 

cates, during the first macroblock packet in a new video FIG. 2 is a diagrammatic illustration of a data multi- 
frame, whether data in the new video frame is provided piex format used in lines 1 and 2 of an HDTV video 
in a video mode or a film mode. Means are also pro- frame; 
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FIG. 3 is a diagrammatic illustration of a data multi- 
plex format used in odd lines 3 to 1049 and even lines 4 
to 1050 of an HDTV video frame; 

FIG. 4 is a diagrammatic illustration showing the 
format of a macroblock packet in accordance with the 
present invention; and 

FIG. 5 is a block diagram of receiver apparatus in 
accordance with the present invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

In the communication of digital HDTV signals, a 
video frame is divided into various subcomponents so 
that the picture represented by the frame can be pro- 
cessed as a plurality of smaller portions thereof. FIG. 1 
illustrates one way to divide a picture frame for process- 
ing in accordance with the present invention. A full 
frame 100, representing a "snapshot" of a continuous 
television picture, is divided into four vertical sub- 
frames 102. Each subframe contains sixty macroblocks 20 
104, which extend horizontally across the subframe and 
are stacked in the vertical direction. A macroblock 104 
is an image area of the picture that comprises eleven 
superblocks 106 that are positioned side-by-side hori- 
zontally. Each superblock 106 comprises an image area 25 
that covers four luminance blocks 108 in the horizontal 
direction and two luminance blocks 108 in the vertical 
direction. Each superblock is associated with one chro- 
minance block (not shown) each for U and V derived 



8 



mined using 32 bits per line (i.e., 64 bits per line pair). 
This provides a data rate of 1.01 Mbs for each of a 
plurality of audio channels. 
During lines 1 and 2 of each video frame, a 24 bit sync 
5 sequence 128 is transmitted for maintaining overall syn- 
chronization. A system control word 130 and next mac- 
roblock position (NMP) word 132 are also contained in 
the data multiplex format 120 for lines 1 and 2 of each 
video frame. The system control word contains a 24 bit 
10 control word and a 16 bit frame count, for a total of 40 
bits. The NMP word is a 16 bit word that indicates the 
beginning position of the next macroblock within the 
following video block 134. The NMP word is used in 
effecting the initial video acquisition and is also used, in 
combination with a DLEN signal described below, to 
recover from an overall loss of synchronization. The 
end of the data multiplex format 120 for lines 1 and 2 of 
each video frame contains actual video information 134, 
comprising a plurality of macroblock packets that are 
formatted in accordance with the present invention. 
When the data is communicated using 16-QAM (quad- 
rature amplitude modulation), 720 bits of video informa- 
tion will be included in the data multiplex format for 
lines 1 and 2 of each video frame. Where 32 QAM is 
used, 1032 bits of video information are provided for 
each of lines 1 and 2. Thus, multiplex format 120 will 
contain a total of either 848 bits or 1160 bits prior to 
forward error coding, depending on the QAM mode. 
The multiplex format 140 for odd lines 3 to 1049 and 



15 



from that image area. Each luminance or chrominance 30 even lines 4 to 1050 contains the control word 122, data 



block 108 comprises an 8x8 matrix of pixels 110. Each 
pixel comprises an eight bit active video sample (lumi- 
nance or chrominance). The individual pixel bits 112 
form an eight bit pixel word 110. 

The representation of an image by digitized samples is 35 
generally referred to as PCM coding. PCM coding is 
also known as "intraframe" coding. In intraframe cod- 
ing, each video frame is coded independently, without 
reference to any other video frame. In "interframe 1 * 
coding, also known as DPCM coding, a frame being 40 
coded is compared to one or more other frames to de- 
rive a difference signal. Such techniques are used, for 
example, in systems that provide coding using motion 
compensation. 

In order to transmit HDTV signals from a transmitter 45 
to one or more receivers, various data other than the 
video data must be transmitted. For example, control 
data, textual data, audio data, synchronization data, and 
other information necessary to the recovery of the 
video and audio information must be communicated. In 50 
a system in accordance with the present invention, a 
multiplex format as shown in FIGS. 2 and 3 can be used 
to communicate all of the various HDTV information 



word 124, and audio data 126 as in multiplex format 120. 
Multiplex format 140 does not include sync, system 
control, or NMP information. Instead, it carries a larger 
amount of video data 142 in the form of macroblock 
packets in accordance with the present invention. For 
16-QAM communication, multiplex format 140 carries 
800 bits of video information. For 32-QAM format, 
format 140 carries 1 1 12 bits of video information. Thus, 
depending on the QAM mode, the data multiplex for 
each of lines 3 to 1050 will carry a total of 848 bits or 
1 160 bits, prior to forward error correction, depending 
on the QAM transmission mode. 

The video information for each of the lines of a video 
frame is transmitted as a sequence of macroblock pack- 
ets. These macroblock packets are variable in length 
and therefore cannot be aligned with the boundaries of 
the video portions 134, 142 illustrated in FIGS. 2 and 3, 
respectively. Therefore, the macroblock packets are 
transmitted asynchronously with the beginning of one 
macroblock packet occurring immediately after the end 
of the previous one. A macroblock packet is continued 
during the video portion of the next line if it is too large 
to fit within the remaining space of the current video 
portion. At the decoder, synchronization is achieved 



to a receiver. FIG. 2 illustrates the data multiplex for- 
mat 120 for lines 1 and 2 of each new video frame. FIG. 55 through the use of the NMP word 132 that is communi 
3 illustrates the data multiplex format 140 for each of cated in lines 1 and 2 in each video frame, 
odd lines 3 to 1049 and even lines 4 to 1050 of each The macroblock packet format is illustrated in FIG. 
video frame. 4. Video overhead is inserted at the beginning of each 

Referring first to the data multiplex format of FIG. 2, macroblock. As indicated above in connection with 
a control word 122 is used for subscriber addressing and 60 FIG. 1, a macroblock contains 1 1 superblocks and corn- 



is sent at the beginning of each line. In the illustrated 
embodiment, control word 122 consists of four bits per 
line (i.e., eight bits per two-line time) which corre- 
sponds to a data rate of 125.87 kbps. A data word 124 
also consists of four bits per line (eight bits per two-line 65 
time) and is used for sending auxiliary data. The 125.87 
kbps data rate provides sufficient capacity for up to 
thirteen 9600 baud data streams. Audio data 126 is trans- 



prises one row of an image subframe. However, the first 
macroblock of each subframe is an exception, in which 
no video data is transmitted. The first macroblock of 
each subframe is used to identify whether the macrob- 
lock is the first in a new frame, to specify which of the 
four subframes the macroblock is associated with,, and 
to provide information identifying whether the macrob- 
lock is in a film mode format or video mode format, 
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together with frame count information for use during 
film mode. 

The macroblock packet format contains various 
fields. Some of the fields are dependent on the type of 
coding used for the information contained in the packet 
Therefore, different packets may contain different 
fields. All of the fields are illustrated in FIG. 4, with 
jumps to indicate the conditions under which certain 
fields are eliminated. The various fields are defined as 
follows: 

FID The frame ID bit sent at the beginning of each 
macroblock. FID is 1 if the macroblock is the first in a 
new frame and 0 otherwise. 

CID Channel ID bit specifying which of the four 
subframes is to be associated with the current macrob- 
lock. 

FILM Sent during the first macroblock of a new 
frame.. FILM is 1 when 24 frame/sec. film mode is used 
and the three-two pulldown process is required for 
display at the decoder. FILM is 0 when in video mode. 

DFM Frame count sent during the first macroblock 
of a new frame and used primarily to identify the three- 
two pulldown phase when in film mode. The transmit- 
ted frames are counted sequentially whether in film 
mode or video mode. 

QL Global quantization level ranging from 0 to 31. It 
is required for inverse normalization of the transmit- 
ted/received DCT coefficients. 

MPCM When set to 1, indicates that the entire mac- 
roblock has been encoded in PCM mode. Subsequently, 30 
all of the SPCM, LPCM, BPCM and MV fields de- 
scribed below are omitted. 

DQL When set to 1, indicates the presence of super- 
blocks that do not use the global quantization level 
(QL). 

DLEN The length of the macroblock. This is to 
prevent a loss of synchronization in the event of a trans- 
mission error. 
FLD Includes one bit for each of the 1 1 superblocks 
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is 



20 



25 



35 



VIDEO Compressed video data. 
Referring to the above list in conjunction with FIG. 
4, it can be seen that a particular macroblock packet will 
include different fields depending on the coding of the 
video information. In the illustrated embodiment, each 
packet commences with the FID field 152. The number 
within the box indicates the number of bits within the 
field, the CID field 154 is then provided. If FID field 
152 indicated that this was the first macroblock packet 
in a new frame, the macroblock packet format will 
proceed along path 156 and the next field provided is a 
four bit "reserved" field 158. This field merely provides 
filler bits, so that the macroblock packet will always end 
on an eight bit byte boundary. It is noted that the sum of 
fields 152, 154, 158, 160, and 162, which is the path 
taken when the macroblock packet is the first in a new 
frame, totals sixteen bits, which is a multiple of eight. 
Following the reserved field 158, comes FILM field 160 
and DFM field 162. This completes the format for the 
first macroblock packet of each new video frame. 

For macroblock packets other than the first in a video 
frame, the QL field 164 follows CID field 154. In the 
event that no video data is to be sent in the current 
macroblock packet, for example if the video buffer is 
filling up and there is a concern that it could overflow 
if additional video data were loaded into it, the quanti- 
zation level is set to 31 and no further fields are pro- 
vided in the current macroblock packet. This is indi- 
cated by path 165 in FIG. 4. 

If the quantization level is less than 31, the next field 
in the macroblock packet will be MPCM field 166. This 
is followed by DQL field 168 and the DLEN field 170. 
The DLEN field is followed by the FLD field 172, 
unless the superblock corresponding to the current 
macroblock packet is formatted in a film mode, in 
which case path 171 is taken and no FLD field is pro- 
vided. If the macroblock packet corresponds to a mac- 
roblock containing superblocks that do not all use the 
global quantization level, as indicated by the DQL field 



within the macroblock. Each bit indicates whether the 40 168 being set to 1, VQL field 176 is next provided. 



corresponding superblock has been processed in frame 
mode (FLD is 0) or field mode (FLD is 1). 

VQL Includes two bits for each of the eleven super- 
blocks within the macroblock. Each pair indicates a 
correction factor to be applied to the global quantiza- 
tion level (QL). 

SPCM Includes two bits for each of the eleven super- 
blocks Within the macroblock. It is used to specify the 
mode of PCM/DPCM overhead encoding for the eight 



However, if all of the superblocks use the global quanti- 
zation level, DQL will be set to zero and path 174 will 
be followed, in which case no VQL field is provided. 
The remaining fields (prior to the variable length 
45 video data 192 in the macroblock packet) relate to the 
provision of DPCM coding. In the event that there is no 
DPCM coded data in the entire macroblock, the 
MPCM field 166 will have been set to 1, and path 178 
will be followed so that no additional fields are pro- 



luminance blocks and two chrominance blocks within 50 vided between VQL field 176 and the video data field 



each superblock. SPCM may have one of four values: 

0 All blocks are PCM. 

1 All blocks are DPCM. 

2 One luminance block is PCM. All other blocks are 
DPCM. 

3 PCM and DPCM blocks occur arbitrarily within 
. the superblock. 

LPCM LPCM is sent when a single luminance block 
within the ith superblock is PCM (SPCM is 2). It is 



192. However, if the MPCM field is set to zero, indicat- 
ing that at least some of the macroblock data has been 
encoded in DPCM mode, a first SPCM field 180 will be 
provided for the first superblock within the macrob- 
55 lock. This is a two bit field, that specifies the mode of 
PCM/DPCM overhead encoding for each of the lumi- 
nance and chrominance blocks within the superblock. If 
the SPCM field is set to 0, indicating that all blocks in 
the superblock are PCM coded, path 182 is followed 



a three bit number indicating the location of the 60 and no additional fields are provided for that super- 



PCM block 

BPCM BPCM is sent when PCM and DPCM blocks 
occur arbitrarily Within the ith superblock (SPCM 
is 3). It uses ten bits to specify the PCM/DPCM 
decision for the eight luminance blocks and the two 65 
chrominance blocks. 

MV A ten bit motion vector that is sent for each 
superblock containing at least one DPCM block. 



block in the macroblock packet If SPCM is set to 1, 
indicating that all of the blocks in the superblock are 
DPCM coded, path 184 is followed and a motion vector 
field 190 is provided containing the motion vector infor- 
mation for the superblock. If the SPCM field is set to 2, 
indicating that one luminance block is PCM coded and 
all other blocks within the superblock are DPCM 
coded, an LPCM field 186 is provided. This identifies 
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the location of the single PCM block within the super- 
block. The motion vector field 190 is also provided to 
enable decoding of the remaining DPCM coded data. In 
the event that the SPCM field is set to 3, indicating that 
PCM and DPCM blocks occur arbitrarily within the 5 
superblock, a BPCM field 188 is provided to specify the 
PCM/DPCM status of each of the luminance and chro- 
minance blocks in the superblock. Again, the motion 
vector field 190 is provided to enable the decoding of 
the DPCM encoded data. 10 

Following the macroblock packet fields for the first 
superblock, are similar fields for the remaining super- 
blocks within the current macroblock. One set of fields 
for a subsequent superblock is illustrated in FIG. 4. 
These are fields 180', 186', 188', and 190', and paths 182', 15 
and 184'. 

After all of the fields for each superblock within the 
current macroblock have been provided, the macrob- 
lock packet format is concluded with the video field 
192. Those skilled in the art will appreciate that various 20 
of the fields indicated in FIG. 4 can be provided in a 
different order, and that the scope of the present inven- 
tion is not limited to the specific field order illustrated. 

There is always a possibility that a transmission error 
will occur that could cause one or more bits in a mac- 25 
roblock packet to be dropped. In order to recover from 
such an error, macroblock packets in accordance with 
the present invention include the DLEN field 170 that 
indicates the length of the macroblock packet. The 
communications receiver that receives the macroblock 30 
packets will check the NMP word 132 provided prior 
to the video information in lines 1 and 2 of each new 
video frame (FIG. 2) against the macroblock packet 
length provided in the DLEN field of each macroblock 
packet. If the NMP word and DLEN field do not point 35 
to the same position in the incoming data for the end of 
the current macroblock and start of the next macrob- 
lock, the receiver will assume that the NMP word is 
correct and reacquire the signal so that the error will 
not propagate. As a secondary precaution, the receiver 40 
will keep track of the value of the FID field 152 in each 
of the macroblock packets for each video frame. There 
should be only one FID field that is set to 1 for each 
video frame. If more than one such FID field is de- 
tected, an error has obviously occurred and the receiver 45 
will reacquire the signal. 

FIG. 5 illustrates a receiver for use in connection 
with the present invention. The signals are received via 
an antenna 200 (or other source such as a cable) and 
input to a conventional radio frequency (RF) tuner 202. 50 
Channels are selected by a television viewer via a key- 
board or remote control that interfaces with a user 
microprocessor 222 via a user input terminal 224. The 
user microprocessor 222 outputs a channel select signal 
to tuner 202. The tuned signal is output to a demodula- 55 
tor 204 at an intermediate frequency (IF) in accordance 
with well known techniques. The demodulator demod- 
ulates the received signal, which is typically communi- 
cated using QAM. The demodulated signal is filtered in 
a filter 206, and applied to a tracking circuit 208 for 60 
feedback to the demodulator in a conventional manner. 
Multi-path distortions common in terrestrial transmis- 
sion are combatted at the demodulator 204 by an adapt- 
ive equalizer contained within the demodulator. 

A forward error correction (FEC) decoder 210 re- 65 
ceives the filtered, demodulated channel signal and 
corrects for random or burst errors in the received 
signal providing substantially error-free data to a syn- 



chronization/data selector 212. The sync/data selector 
212 maintains overall synchronization and provides 
video, audio, data/text, and control data streams to 
appropriate processing blocks in the receiver. A mem- 
ory 214 stores firmware for the operation of sync/data 
selector 212 as well as various information recovered 
from the multiplexed data stream illustrated in FIGS. 2 
and 3. For example, memory 214 will store the NMP 
word 132 for checking against the DLEN field of each 
successive macroblock packet to verify that the re- 
ceived signal is in proper synchronization. Sync/data 
selector 212 also recovers the sync word 128 from lines 
1 and 2 of each new video frame to provide receiver 
synchronization. 

The received macroblock packets are communicated 
by sync/data detector 212 to a digital video decoder 216 
for decoding and output of the video information. On- 
screen display data generated by user microprocessor 
222 is also input to the digital video decoder for output 
to a user's video display. A digital audio decoder 218 
receives the audio data 126 from the sync/data selector 
for decoding and output of the audio signals. A data/- 
text decoder 220 can also be provided to receive and 
decode other data or text information for output to a 
computer or an appropriate display. 

It will now be appreciated that the present invention 
provides a macroblock packet format for use in a digital 
HDTV system, as well as receiver apparatus for receiv- 
ing and decoding HDTV signals that carry video infor- 
mation in the macroblock packet format. Various fields 
are provided in the macroblock packet format to enable 
the receiver to properly recover and decode the video 
information. The macroblock packets are transmitted as 
part of a data multiplex signal format that also includes 
audio data, control data, synchronization information, 
and optional text or auxiliary data. 

Those skilled in the art will appreciate that although 
the invention has been described in connection with a 
specific embodiment thereof, various adaptations and 
modifications may be made thereto without departing 
from the spirit and scope of the invention as set forth in 
the claims. 

What is claimed is: 

1. A method for communicating HDTV signals 
wherein successive video frames are each divided into a 
plurality of macroblocks, said macroblocks comprise a 
plurality of superblocks, said superblocks contain a 
plurality of luminance and chrominance video data 
blocks, and wherein at least a portion of said macrob- 
locks are communicated in variable length macroblock 
packets having a format that includes a plurality of 
fields, comprising the steps of: 

providing a DLEN field in said format to identify the 
length of the macroblock packet; and 

providing a compressed, variable length encoded 
portion of video data in said format. 

2. A method in accordance with claim 1 comprising 
the further steps of: 

* providing an MPCM field in said format to identify 
whether the entire macroblock packet has been 
encoded in PCM mode; and 
in the event that the entire macroblock packet has not 
been encoded in PCM mode, providing at least one 
additional —PCM field for distinguishing between 
portions of superblocks that comprise PCM en- 
coded data and portions of superblocks that com- 
prise DPCM encoded data. 
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3. A method in accordance with claim 2 comprising 
the further step of: 

providing a motion vector field in said format con- 
taining motion vector data corresponding to said 
DPCM encoded data. 

4. A method in accordance with claim 2 wherein: 
a first additional -PCM field is an SPCM field that 

specifies whether: 

all of the blocks of video data in a particular super- 
block comprise PCM encoded data, or 

all of the blocks of video data in said particular 
superblock comprise DPCM encoded data, or 

one luminance block of video data in said particular 
superblock comprises PCM encoded data and 
the rest of the blocks therein comprise DPCM 
encoded data, or 

PCM and DPCM encoded blocks of video data 
occur arbitrarily in said particular superblock. 

5. A method in accordance with claim 4 wherein: 
a second additional -PCM field is an LPCM field that 

is used when one luminance block in a superblock 
is PCM encoded and all other video data blocks in 
said superblock are DPCM encoded, and that iden- 
tifies the PCM encoded luminance block. 

6. A method in accordance with claim 4 wherein: 
a second additional -PCM field is a BPCM Meld that 

is used when PCM and DPCM encoded blocks of 
video data occur arbitrarily in a superblock, and 
that identifies which of the blocks of video data in 
the superblock are PCM encoded and which are 
DPCM encoded. 

7. A method in accordance with claim 1 comprising 
the further step of: 

providing a QL field in said format for indicating a 
global quantization level of said superblocks. 

8. A method in accordance with claim 7 comprising 
the. further step of: 

providing a DQL field in said format for indicating 
the presence of superblocks that do not use the 40 
global quantization level. 

9. A method in accordance with claim 8 comprising 
the further step of: 

providing a VQL field in said format for indicating a 
correction factor to be applied to said global quan- 
tization level. 

10. A method in accordance with claim 1 comprising 
the further step of: 

providing an FID field in said format for indicating if 
a macroblock packet is the first macroblock packet 
in a new video frame. 

11. A method in accordance with claim 10 compris- 
ing the further step of: 

providing a FILM field in said format for indicating, 
during the first macroblock packet in a new video 
frame, whether data in the new video frame is 
provided in a video mode or a film mode. 

12. A method in accordance with claim 10 compris- 
ing the further step of: . 

providing a DFM field in said format for indicating, 
during the first macroblock packet in a new video 
frame, a frame number for the new video frame. 

13. A method in accordance with claim 1 wherein 
said successive video frames are divided into a plurality 65 
of subframes, each subframe containing a subset of said 
plurality of macroblocks, said method comprising the 
further step of: 
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providing a CID field in said format for indicating the 
subframe with which the macroblock packet is 
associated. 

14. A method in accordance with claim 1 wherein 
said superblocks have been processed in one of a frame 
mode and a field mode, said method comprising the 
further step of: 

providing an FLD field in said format that indicates 
in which of said frame mode and field mode each of 
said superblocks has been processed. 

15. A method in accordance with claim 1 wherein 
said successive video frames are divided into a plurality 
of subframes, each subframe containing a subset of said 
plurality of macroblocks, said method comprising the 
further steps of providing said format with each of: 

an FID field for indicating if the macroblock packet 
is the first macroblock packet in a new video frame; 

a FILM field for indicating, during the first macrob- 
lock packet in a new video frame, whether data in 
the new video frame is provided in a video mode or 
a film mode; 

a DFM field for indicating, during the first macrob- 
lock packet in a new video frame, a frame number 
for the new video frame; 

a CID field that indicates the subframe with which 
the macroblock packet is associated; 

a QL field for indicating a global quantization level of 
said superblocks; 

a DQL field for indicating the presence of super- 
blocks that do not use the global quantization level; 

an MPCM field for identifying whether the entire 
macroblock packet has been encoded in PCM 
mode; 

an SPCM field indicative of which of PCM encoded 
data and DPCM encoded data are included in the 
video data blocks of a corresponding superblock; 

one of an LPCM and a BPCM field for each super- 
block having both PCM and DPCM data; 

said LPCM field being present when one luminance 
block in the superblock is PCM encoded and all 
other video data blocks in said superblock are 
DPCM encoded, and identifying the PCM en- 
coded luminance block; and 

said BPCM field being present when PCM and 
DPCM encoded blocks of video data occur arbi- 
trarily in a superblock, and identifying which of the 
blocks of video data in the superblock are PCM 
encoded and which are DPCM encoded; and 

a motion vector field containing motion vector data 
corresponding to DPCM encoded blocks of video 
data. 

16. A method in accordance with claim 15 compris- 
ing the further step of: 

providing an FLD field in said format for indicating 
in which of a frame mode and field mode each of 
the superblocks corresponding to a macroblock 
packet has been processed. 

17. A method in accordance with claim 16 compris- 
ing the further step of: 

providing a VQL field in said format for indicating a 
correction factor to be applied to said global quan- 
tization level, when said DQL field indicates that 
the quantization level used for one or more super- 
blocks of the current macroblock packet differ 
from the global quantization level. 

18. Receiver apparatus for decoding variable length 
digital HDTV macroblock packets having a plurality of 
fields and being representative of macroblock portions 
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of successive video frames, wherein said macroblock 
portions comprise a plurality of superblocks and said 
superblocks contain a plurality of luminance and chro- 
minance video data blocks, comprising: 
means for detecting a DLEN field in a received mac- 5 
roblock packet, said DLEN field identifying the 
length of the macroblock packet; and 
means responsive to a detected DLEN field for main- 
taining a plurality of received macroblock packets 
in synchronization for the recovery of video data 10 
therefrom. 

19. Receiver apparatus in accordance with claim 18 
further comprising: 

means for detecting an MPCM field in a received 
macroblock packet, said MPCM field identifying IS 
whether the entire macroblock packet has been 
encoded in PCM mode; and 

means responsive to a detected MPCM field for de- 
tecting at least one additional -PCM field in the 
event that the entire macroblock packet has not 20 
been encoded in PCM mode, wherein said at least 
one additional -PCM field comprises an SPCM 
field indicative of which of PCM encoded data and 
DPCM encoded data are included in the video data 
blocks of a superblock. 25 

20. Receiver apparatus in accordance with claim 19 
wherein said means for detecting at least one additional 
-PCM field detect one of an LPCM and a BPCM field 
for each superblock having both PCM and DPCM data; 

said LPCM field being present when one luminance 30 
block in the superblock is PCM encoded and all 
other video data blocks in said superblock are 
DPCM encoded, and identifying the PCM en- 
coded luminance block; and 
said BPCM field being present when PCM and 35 
DPCM encoded blocks of video data occur arbi- 
trarily in a superblock, and identifying which of the 
blocks of video data in the superblock are PCM 
encoded and which are DPCM encoded; 



for detecting an FLD field in a received macrob- 
lock packet, said FLD field indicating in which of 
a frame mode and field mode each of the super- 
blocks corresponding to the received macroblock 
packet has been processed. 

23. Receiver apparatus in accordance with claim 21 
further comprising: 

means responsive to a detected FID field for pro- 
ceeding to receive a next successive macroblock 
packet after the detection of said FILM and DFM 
fields. 

24. Receiver apparatus in accordance with claim 18 
further comprising: 

means for detecting a QL field in a received macrob- 
lock packet that indicates a global quantization 
level of said superblocks. 

25. Receiver apparatus in accordance with claim 24 
further comprising: 

means responsive to a detected QL field for proceed- 
ing to receive a next successive macroblock packet 
when said QL field indicates a global quantization 
level that exceeds a predetermined value. 

26. Receiver apparatus in accordance with claim 24 
further comprising: 

means for detecting a DQL field in a received mac- 
roblock packet that indicates the presence of super- 
blocks that do not use the global quantization level; 
and 

means responsive to a detected DQL field for detect- 
ing a VQL field in a received macroblock that 
indicates a correction factor to be applied to said 
global quantization level when said DQL field 
indicates that the quantization level used for one or 
more superblocks of the current macroblock 
packet differ from the global quantization level. 

27. Receiver apparatus in accordance with claim 18 
wherein said successive video frames are divided into a 
plurality of subframes, each subframe containing a plu- 
rality of macroblock portions, said receiver apparatus 



said receiver apparatus further comprising means for 40 further comprising: 
detecting a motion vector field in a received mac- means for detecting a CID field in a received macrob- 
roblock packet containing motion vector data cor- lock packet that indicates the subframe with which 

responding to DPCM encoded blocks of video the macroblock packet is associated, 

data. 28. Receiver apparatus in accordance with claim 18 

21. Receiver apparatus in accordance with claim 18 45 wherein said macroblock packets are received within 



further comprising: 
means for detecting an FID field in a received mac- 
roblock packet for indicating if the macroblock 
packet is the first macroblock packet in a new 
video frame; 

means responsive to a detected FID field for detect- 
ing a FILM field in a received macroblock packet 
that indicates, during the first macroblock packet 
in a new video frame, whether data in the new 
video frame is provided in a video mode or a film 55 
mode; and 

means responsive to a detected FID field for detect- 
ing a DFM field in a received macroblock packet 
that indicates, during the first macroblock packet 
in a new video frame, a frame number for the new 60 
video frame. 

22. Receiver apparatus in accordance with claim 21 
further comprising: 

memory means for storing a film/video mode flag 
derived from said FILM field; and 

means, responsive to an indication by said film/video 
mode flag that a video frame in which the macrob- 
lock packet resides contains data in a video mode, 



video portions of successive lines of HDTV data, said 
lines containing additional data including, in at least one 
line of each video frame, a next macroblock position 
(NMP) word indicative of the beginning position of the 
50 next macroblock in a data stream being received, said 
apparatus further comprising: 
means for detecting said NMP word; 
means for comparing a next macroblock position 
indicated by a detected NMP word to a next mac- 
roblock position indicated by DLEN data con- 
tained in a detected DLEN field, to determine if 
they both point to the same position in the data 
stream being received; and 
means responsive to said comparing means for resyn- 
chronizing the receiver apparatus to said data 
stream if the NMP word and the DLEN data fail to 
point to the same position. 
29. Receiver apparatus for decoding variable length 
digital HDTV macroblock packets having a plurality of 
65 fields and being representative of macroblock portions 
of successive video frames divided into a plurality of 
subframes, each subframe containing a plurality of said 
macroblock portions, wherein said macroblock portions 
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comprise a plurality of superblocks and said super- 
blocks contain a plurality of luminance and chromi- 
nance video data blocks, comprising: 
means for detecting an FID field in a received mac- 
roblock packet for indicating if the macroblock S 
packet is the first macroblock packet in a new 
video frame; 

means responsive to a detected FID field for detect- 
ing a FILM field in a received macroblock packet 
that indicates, during the first macroblock packet 10 
in a new video frame, whether data in the new 
video frame is provided in a video mode or a film 
mode; 

means responsive to a detected FID field for detect- 
ing a DFM field in a received macroblock packet IS 
that indicates, during the first macroblock packet 
in a new video frame, a frame number for the new 
video frame; 

means responsive to a detected FID field for pro- 
ceeding to receive a next successive macroblock 20 
packet after the detection of said FILM and DFM 
fields; 

means for detecting a CID field in a received macrob- 
lock packet that indicates the subframe with which 
the macroblock packet is associated; 25 

means for detecting a QL field in a received macrob- 
lock packet that indicates a global quantization 
level of said superblocks; 

means responsive to a detected QL field for proceed- 
ing to receive a next successive macroblock packet 30 
when said QL field indicates a global quantization 
level that exceeds a predetermined value; 

means for detecting a DQL Meld in a received mac- 
roblock packet that indicates the presence of super- 
blocks that do not use the global quantization level; 35 

means for detecting a DLEN field in a received mac- 
roblock packet, said DLEN field identifying the 
length of the macroblock packet; 

means for detecting an. MPCM field in a received 
macroblock packet, said MPCM field identifying 40 
whether the entire macroblock packet has been 
encoded in PCM mode; 

means responsive to a detected MPCM field for de- 
tecting an SPCM field indicative of which of PCM 
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encoded data and DPCM encoded data are in- 
cluded in the video data blocks of a corresponding 
superblock; 

means responsive to a detected SPCM field for de- 
tecting one of an LPCM and a BPCM field for each 
superblock having both PCM and DPCM data; 

said LPCM field being present when one luminance 
block in the superblock is PCM encoded and all 
other video data blocks in said superblock are 
DPCM encoded, and identifying the PCM en- 
coded luminance block; and 

said BPCM field being present when PCM and 
DPCM encoded blocks of video data occur arbi- 
trarily in a superblock, and identifying which of the 
blocks of video data in the superblock are PCM 
encoded and which are DPCM encoded; 

means for detecting a motion vector field containing 
motion vector data corresponding to DPCM en- 
coded blocks of video data; and 

means for detecting variable length encoded video 
data in a received macroblock packet. 

30. Receiver apparatus in accordance with claim 29 
further comprising: 

memory means for storing a film/video mode flag 
derived from said FILM field; and 

means responsive to said film/video mode flag, for 
detecting an FLD field in a received macroblock 
packet that indicates in which of a frame mode and 
field mode each of the superblocks corresponding 
to a macroblock packet has been processed, when 
said film/video mode flag indicates that a video 
frame in which the macroblock packet resides con- 
tains data in a video mode. 

31. Receiver apparatus in accordance with claim 29 
further comprising: 

means responsive to a detected DQL field, for detect- 
ing a VQL field in a received macroblock- that 
indicates a correction factor to be applied to said 
global quantization level, when said DQL field 
indicates that the quantization level used for one or 
more superblocks of the current macroblock 
packet differ from the global quantization level. 
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